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Abstract. A class of valued constraint satisfaction problems (VCSPs) is characterised by a valued 
constraint language, a fixed set of cost functions on a finite domain. An instance of the problem 
is specified by a sum of cost functions from the language with the goal to minimise the sum. 
This framework includes and generalises well-studied constraint satisfaction problems (CSPs) and 
maximum constraint satisfaction problems (Max-CSPs). 

Our main result is a precise algebraic characterisation of valued constraint languages whose 
instances can be solved exactly by the basic linear programming relaxation. Using this result, we 
obtain tractability of several novel and previously widely-open classes of VCSPs, including problems 
over valued constraint languages that are: (1) submodular on arbitrary lattices; (2) bisubmodular 
(also known as fc-submodular) on arbitrary finite domains; (3) weakly (and hence strongly) tree- 
submodular on arbitrary trees. 
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1. Introduction 

The constraint satisfaction problem (CSP) provides a common framework for many theoretical 
and practical problems in computer science. An instance can be vaguely described as a set of 
variables to be assigned values from the domains of the variables so that all constraints are sat- 
isfied [33]. The CSP is NP-complete in general and thus we are interested in restrictions which 
give rise to tractable classes of problems. Following Feder & Vardi [21], we restrict the constraint 
language; that is, all constraint relations in a given instance must belong to a fixed, finite set of re- 
lations on the domain. The most successful approach to classifying language-restricted CSPs is the 
so-called algebraic approach [TJEUEO] , which has led to several complexity classifications [UE1E1E] 
and algorithmic characterisations [2j[27] going beyond the seminal work of Schaefer |46] , 

Motivated by reasons both theoretical (optimisation problems are different from decision prob- 
lems) and practical (many problems are over-constrained and hence have no solution, or under- 
constrained and hence have many solutions), we study valued constraint satisfaction problems 
(VCSPs) 0147]. A valued constraint language is a finite set of cost functions on the domain, 
and a VCSP instance is given by a weighted sum of cost functions from the language with the 
goal to minimise the sum. (CSPs correspond to the case when the range of all cost functions is 
{0, oo}, and Max-CSPs correspond to the case when the range of all cost functions is {0, 1}Q) The 
VCSP framework is very robust and has also been studied under different names such as Min-Sum 
problems, Gibbs energy minimisation, Markov Random Fields (MRF), Conditional Random Fields 
(CRF) and others in several different contexts in computer science [15, 40, 49J . 

Given the generality of the VCSP, it is not surprising that only few complexity classifications are 
known. In particular, only Boolean (on a 2-element domain) languages [11( 116] and conservative 
(containing all {0, l}-valued unary cost functions) languages [36] have been completely classified 
with respect to exact solvability. On the algorithmic side, most known tractable languages are 
somewhat related to submodular functions on distributive lattices [10 ( 111 (1321 36J . 

An alternative approach for solving VCSPs is using linear programming (LP) and semidefinite 
programming (SDP); these have been used mostly for approximation [3. 18. 391135]. 

Contribution We study the power of the basic linear programming relaxation (BLP). Our main 
result (Theorem I4.ip is a precise characterisation of valued constraint languages for which BLP 
is a decision procedure. In more detail, we characterise valued constraint languages over which 
VCSP instances can be solved exactly by a certain basic linear program. Equivalently, we show 
precisely when a particular integer programming formulation of a VCSP has zero integrality gap. 
The characterisation is algebraic in terms of fractional polymorphisms [9] . 

Our work is the first link between solving VCSPs exactly using LP and the algebraic machinery for 
VCSPs introduced by Cohen et al. in [9(112] . Part of the proof is inspired by the characterisation of 
width-1 CSPs [19(121] . One of the main technical contributions is a construction of totally symmetric 
fractional polymorphisms of all arities (Theorem 14. 4p . 

This result allows us to demonstrate that several valued constraint languages are covered by 
our characterisation and thus are tractable; that is, VCSP instances over these languages can be 
solved exactly using BLP. New tractable languages include: (1) submodular languages on arbitrary 
lattices; (2) bisubmodular (also known as /c-submodular) languages on arbitrary finite domains; 
(3) weakly (and hence strongly) tree-submodular languages on arbitrary trees. The complexity of 
(subclasses of) these languages has been mentioned explicitly as open problems in [20 ][26l[35| [37] . 
More generally, we show that any valued constraint language with a binary multimorphism in which 
at least one operation is a semi-lattice operation is tractable (cf. Section [6]). Our results cover all 
known tractable finite- valued constraint languages. 

^With respect to exact solvability, Max-CSPs ("maximising the number of satisfied constraints") are polynomial- 
time equivalent to Min-CSPs ("minimising the number of unsatisfied constraints"). Therefore, with respect to exact 
solvability, Max-CSPs are polynomial-time equivalent to {0, l}-valued VCSPs. 
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Related work Apart from identifying tractable classes of CSPs and VCSPs with respect to exact 
solvability, the approximability of Max-CSPs has attracted a lot of attention [17 H 3 H f33] . Under 
the assumption of the unique games conjecture [34 1 . Raghavendra showed how to approximate all 
Max-CSPs and finite- valued VCSPs optimally [45] o For VCSPs that are tractable, Raghavendra's 
algorithms provide a PTAS, but it seems notoriously difficult to determine the approximation 
ratios of these algorithms. Very recently, Max-CSPs that are robustly approximable have been 
characterised as those having_ bounded width [3l ll8ll39j . Specifically, Kun et al. studies the question 
of which Weighted Max-CSPsj can be robustly approximated using BLP [39] . Their result is related 
but incomparable to ours as it applies to robust approximability and not to exact solvability, except 
for the special case of width-1 CSPs. In particular, "solving" ("deciding") for us means finding an 
optimum solution to a VCSP instance, which is an optimisation problem, whereas "solving" in [39] 
means (ignoring their results on robust approximability, which do not apply here) the basic LP 
formulation of a CSP instance finds a solution if one existsfl 

We remark that our tractability results apply to the minimisation problem of VCSP instances 
(i.e., the objective function is given by a sum of "local" cost functions) but not to objective functions 
given by an oracle. In particular, submodular functions given by an oracle can be minimised 
on distributive lattices [281 HH], diamonds [38], and several constructions on lattices preserving 
tractability have been identified [37], but it is widely open what happens on non-distributive lattices. 
Similarly, bisubmodular functions given by an oracle can be minimised in polynomial-time on 
domains of size 3 [23], but the complexity is open on domains of larger size |26j . It is known that 
strongly tree-submodular functions given by an oracle can be minimised in polynomial time on 
binary trees [35J, but the complexity is open on general (non-binary) trees. Similarly, it is known 
that weakly tree-submodular functions given by an oracle can be minimised in polynomial time on 
chains and forks [35], but the complexity on (even binary) trees is open. 

Extending the notion of (generalised) arc consistency for CSPs [23,41] and several previously 
studied notions of arc consistencies for VCSPs pH], Cooper et al. introduced optimal soft arc 
consistency (OSAC) [13] , which is a linear program relaxation of a given VCSP instance. Since 
OS AC is is a tighter relaxation than BLP (cf. Appendix [C]), all tractable classes identified in this 
paper are solved by OSAC as well. Similarly, since the basic SDP relaxation from [35] is tighter 
than BLP, all tractable cases identified in this paper are solved by it as well. 

2. Preliminaries 

The set of non- negative rational numbers is denoted by Q>o- A signature r is a set of function 
symbols f, each with an associated positive arity, ar{f). A valued t -structure A (also known as a 
valued constraint language, or just a language) consists of a domain D = D(A), together with a 
function f A : D ar ^ — > Q>o, for each function symbol / € r. (To be precise, these are finite-valued 
structures. In Section El we will extend Q>o with infinity.) 

Let A be a valued r-structure. An instance of VCSP (A) is given by a valued r-structure I. A 
solution to I is a function h : D(I) — > D(A), its measure given by 

J2 f\x)f A {h{x)). 

The goal is to find a solution of minimum measure. This measure will be denoted by Opt^(I). 



2 Note that Max-CSPs (={0, l}-valued VCSPs) and finite-valued VCSPs, respectively, are called CSPs and Gen- 
eralised CSPs (GCSPs), respectively, in [45] . 

3 In Weighted Max-CSPs, every constraint / is {0, c/}-valued, where c/ is a positive constant. Weighted Max-CPSs 
are a special case of VCSPs. 

4 Note that CSPs are defined as {0, l}-valued in [39] and not as {0, oo}-valued, as in this paper. This is needed for 
the LP formulation and the measure of approximability. After all, [33] deals with Max-CSPs. 
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For an m-tuple t, we denote by {i} the set of elements in t. Furthermore, we denote by [t\ the 
multiset of elements in t. 

2.1. Fractional Homomorphisms. Let A and B be valued structures over the same signature 
r. Let B A denote the set of all functions from D(A) to D(B). A fractional homomorphism from 
A to B is a function uj : B A — > Q>o, with Yl g eB A u (9) = 1> sucn that for every function symbol 
/ G r and tuple a G D{A) ar ^\ it holds that 

£ ^( 5 )/ B (5(a)) < / A (a), 

where the functions g are applied component- wise. 

We write A — >f B to indicate the existence of a fractional homomorphism. 

Proposition 2.1. Assume that A—tf B. Then Opt^(I) > Opt B (I), for every instance I. 

Proof. Let w be a fractional homomorphism from A to B, let X = D(I) and let h : X — > A be an 
arbitrary solution. Then, 

/,2 /,2 geB A geB A f,x 

where the sums are over / € r and x G X ar ^'. Hence, there exists aj£ B A such that the measure 
of the solution g o /i to 7 as an instance of VCSP(-B) is no greater than the measure of the solution 
h to I as an instance of VCSP(vl). □ 

2.2. Fractional Polymorphisms. Let A be a valued r-structure, and let D = D{A). An m-ary 
operation on D is a function g : D m — > D. Let denote the set of all m-ary operations on D. 
An m-ary fractional operation is a function ui : Op — > Q>o- Define \\lo\\\ := ^2 g oj(g)- An m-ary 
fractional operation uj is called an m-ary fractional polymorphism [9] if = 1 and for every 
function symbol / € r and tuples a%,..., a m G D ar ^\ it holds that 

£ o;(ff)/ A (ff(a 1 , . . . , a m )) < - £ / A (a<). 

The set {g \ uj(g) > 0} of operations is called the support of uj and is denoted by supp(u>). Let S m be 
the symmetric group on {1, . . . , m}. An m-ary operation g is symmetri^ if for every permutation 
vr G 5 m , we have sOi,.. . ,x m ) = 5(^(1),- ■ -^(m))- 

Definition 1. ^4 totally symmetric fractional polymorphism oj is a fractional polymorphism such 
that if g G supp(w), f/ien 5 is symmetric. 

The superposition of an n-ary operation h with n m-ary operations gi,...,g n is the m-ary 
operation defined by %i, . . . ,g n ](xi, . . . ,x m ) = h(gi(xi, ... ,x m ), ... ,g n (xi, ■■■ ,x m )). A set of 
operations is called a clone if it contains all projections and is closed under superposition. The 
smallest clone that contains a set of operations J- is called the clone generated by T . We say that 
an operation / is generated by T if it is contained in the clone generated by T. 

Definition 2. The superposition, uj[gi, . . . , g n ], of an n-ary fractional polymorphism oj with n 
m-ary operations gi, . . . ,g n is the m-ary fractional operation uj', where 

u'(h f ) = Yl 

h:h'=h\gi,...,g n ] 
Symmetric operations are called totally symmetric in 
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Note that in general u' is not a fractional polymorphism, but it does satisfy the following in- 
equality: 



Y, u\ti)f A (ti(a u ...,a m )) = ^(h)f A (h[g 1 ,...,g n ](a 1 ,...,a m )) 

heo™ 
1 n 



n 



for every / € r and a±, . . . a m G £)<""(/). 

2.3. The Multiset-Structure P m (A). Let A be a valued r-structure, D = D{A), and let m > 1. 
We define the multiset- structure^ P m (A) as the valued structure with domain ((£?)), where ((£?)) 
denotes the multisets of elements from D of size m, and for every A;-ary function symbol / G r, and 

/ pm ( A )(a 1 ,...,a fc ) = -_ min V f A (h\i}, ■ ■ ■ , **[*])■ 

1=1 

The following lemma follows from the definitions (the proof is in the appendix). 

Lemma 2.2. Let A be a valued structure and m > 1. Then P m (A) —}f A if and only if A has an 
m-ary totally symmetric fractional polymorphism. 

3. Basic Linear Programming Relaxation 

Let / and A be valued structures over a common finite signature r. Let X = D{I) and D = D{A). 
The basic LP relaxation (BLP) (sometimes also called the standard, or canonical LP relaxation) 
has variables Xfxa for / G r, x G X ar ^\ a : jx} — > D; and variables //x(a) for x£l,a£D, 

/,2 a:{x}— >D 

s.t. ^ Xf,x,a = Vx{a) V/eT,ier r(/) ,ie{i},fl£D 

(1) <r:(r(a;)=a 

/^(a) = 1 Vx G X 

< \,n < 1 

For any fixed A, BLP is polynomial in the size of a given VCSP (A) instance. Let IP be the 
program obtained from ([1]) together with the constraints that all variables take values in the range 
{0, 1} rather than [0, 1]. This is an integer programming formulation of the original VCSP instance. 
The interpretation of the variables in IP is as follows: /u x (a) = 1 iff variable x is assigned value a; 
A/,z,<r = 1 iff constraint / on scope x is assigned tuple a(x). LP ([T]) is now a relaxation of IP and 
the question of whether ([I]) solves a given VCSP instance I is the question of whether IP has a zero 
integrality gap. 

4. Characterisation 

Definition 3. Let BLP(I,A) denote the optimum of (P). We say that BLP solves VCSP(A) if 
BLP(L, A) = Opt A (/) for every instance L of VCSP(A). 



6 A similar structure for {0, oo}-valued languages was introduced in 
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Solving the BLP provides an optimum value of the VCSP. To obtain an assignment achieving 
this value, we apply self-reduction: Successively try each possible value for a variable and solve the 
altered LP. Once the new optimum matches the original one, proceed with the next variable. 

Theorem 4.1 (Main). Let A be a valued structure over a finite signature. TFAE: 

(i) BLP solves VCSP(A). 

(ii) For every m > 1, P m {A) —}f A. 

(Hi) For every m > 1, A has an m-ary totally symmetric fractional polymorphism, 
(iv) For every n > 1, A has a fractional polymorphism u n such that supp(w n ) generates an n-ary 
symmetric operation. 

The rest of this section is devoted to proving Theorem 14.11 We start with proving §vi§ => (jl]). 

Theorem 4.2. Assume that P m (A) — ^ A for every m > 1. Then BLP solves VCSP(A). 

Proof. Let A*,/i* be an optimal solution to ([I]). Let M be a positive integer such that M ■ A* and 
M ■ (j,* are both integral. 

Let v : X — > (( Jj be defined by mapping x to the multiset in which the elements are distributed 
according to [A*, i.e., the number of occurrences of a in v{x) is equal to M ■ [i* x {a) for each a € D. 

Let / be a fc-ary function symbol in r, and let 

E f I (x)f A (a(x))Xl Si(T = Y J f I ^)( E 

x,cr:{x}^D X a:{S}^D 

be the sum of all terms of the objective function in which / occurs; Now, write 

M - E ^h,j A ^m = f A (a 1 ) + --- + f A (a M ), 

a:{S}^D 

where the a» G D k are such that a A%. -fraction are equal to a(x). 
Let a'i = (ai[i], . . . , om[»]) for i = 1, . . . , k. 

M M 

E \uj a (o-(x)) = F E/ A (^) = ^E/Vi^-.-XM) 

cr:{x}^D 1=1 1=1 

M 



where the last equality follows as the number of a's in is M • So- :C r(s[i])=a ^/x o- = M • ^%u\{p)- 
We now have 

BLP(L,A) = E E /'(*)/ V(*))AW 

f,X <t:{x}— >D 

= £/'(*)( E A W/X*)) 

f€r,x a:{x}~- >D 

> e /^/^m 

= OptpM( A )(I) 

It follows that Opt^J) > BLP(L, A) > OptpAr^(I). Since P M (A) A, the result then 
follows from Proposition 12.11 □ 

To prove (ji]) => (ju]), we express the existence of a fractional homomorphism P m (A) — j4 as a 
system of linear inequalities. We then apply a variant of Farkas' Lemma to show that if for some 
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m > 1 there is no such fractional homomorphism, then there exists an instance I of VCSP(^4) with 
a strictly greater optimum than BLP(J, A) (the proof is in the appendix). 

Theorem 4.3. Let A be a valued structure and assume that BLP solves VCSP(A). Then P m {A) — >t 
A for every m > 1. 

Lemma 12.21 proves 4=> 

Since (|mp (jzu]) follows trivially, it remains to show that ([ro]) (jmp . 

Theorem 4.4. Lei A be a valued structure and assume that for every n > 1, A has a fractional 
polymorphism u n that generates an n-ary symmetric operation. Then, for every m > 1, A has an 
m-ary totally symmetric fractional polymorphism. 

Proof. For an m-ary operation g, let g denote the equivalence class of g under the relation: 
9 ~ 9' g{xi, ■ ■ ■ ,X m ) = g'(Xn(l),. • • ,X n ( m )) for some n € S m- 

Note that we have |^| = 1 if and only if g is symmetric. 

We say that a fractional operation u is weight-symmetric if 

uj(g) = uj(g') whenever g ~ g' . 

We construct an m-ary totally symmetric fractional polymorphism by building a rooted tree in 
a number of stages. At each stage of the construction, every node u of the tree contains an m-ary 
weight-symmetric fractional operation with support on a single equivalence class of ~. For a node 
u, we will also denote this fractional operation by u. Since u is weight-symmetric, it follows that 
u(g) = u(g') for all g, g' G supp(u). This common weight for the operations in the support of u will 
be denoted by w(u). A node u with |supp(u)| = 1 will be called final. 

The following invariants are maintained throughout the construction. 

(a) Every non-leaf node has at least one final child. 

(b) For every node u, we have w(u) > 0. 

(c) For every non-leaf node v, 

^ \\u\\i = IMIi- 

u is a child of v 

(d) For every non-leaf node v, every / € t, and all tuples oi, . . . , a m € D ar ^\ 

^2v(g)f A (g(a 1 ,...,a m ))> ^ S ^u(g)f A (g{ai,...,a m )). 

g u is a child of v 9 

We say that a leaf u is covered (by v), and that v is a covering node (of u) if supp(u) = supp(u) 
and u is a (proper) descendant of v. We say that v is a minimal covering node of u if no descendant 
of v is a covering node of u. 

At the beginning of the construction, the tree consists of a single root r with supp(r) being the 
set of m-ary projections and w(r) = We then apply the following two steps: 

• Expansion: A leaf u that is not final and not covered is chosen to be expanded. This 
amounts to adding a finite non-empty set of children to u while maintaining the invariants. 
The expansion step is repeated until no longer applicable. 

• Pruning: A leaf that is not final and covered is removed together with a number of inter- 
nal nodes while maintaining the invariants. The pruning step is repeated until no longer 
applicable. 

Since there is a finite number of m-ary operations, and hence a finite number of equivalence 
classes of ~, it follows that, eventually, every leaf in the tree that is not final must be covered. 
Hence, the expansion step is only applicable a finite number of times. 

Each round of pruning shrinks the tree by at least one node, but no final leaf is ever removed. 
Therefore we eventually obtain a tree containing only final leaves, at which time the pruning step is 
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no longer applicable. Let L be the set of leaves in the final tree. By repeated application of invariant 
([d]), starting from the root, ^ M e£ M ^ s then an m-ary totally symmetric fractional polymorphism. 

Expansion. We expand a leaf u with |supp(«)| = n as follows: Let to be a k-aiy fractional polymor- 
phism of A such that supp(w) generates an n-ary symmetric operation t. 

We will define a sequence of m-ary weight-symmetric fractional operations fj, each with ||fj||i = 
||tt||i- Let vq = u. Assume that Vi-i has been defined for some i > 1. Let U-\ = min{fj_i(^) | 
g G supp(fj_i)} be the minimum weight of an operation in the support of Vi—\. The fractional 
operation Vi is obtained by subtracting from Vi-\ an equal amount of weight from each operation 
in supp(^j_i) and adding this weight as superpositions of u) by all possible choices of operations in 
Vi~\. The amount subtracted from each operation is so that every operation in supp(fi_i) is 
also in supp(z^). Formally V{ is defined as follows: 

(3lv,9fe)esupp(^_i) fc 

where K = |supp(fj_i)| fe and Xi-i is t ne indicator function of supp(fj_i). 

By definition ||fi||i = ||^i-i||i = To verify that z/j is weight-symmetric, it suffices to verify 

that the sum 

(2) u\9l>--->9k] 

(3lv,9fc)Gsupp(^_i) fe 

is weight-symmetric. Let g ~ g', let ir G S m be such that g(x\, . . . , x m ) = g'(x n ^, . . . , x n r m \) and 
let g'j(xi, . . . ,x m ) = gj(x^(i), ■ ■ • , aV(m)) f°r 1 < J ' < m - Since v%-\ is weight-symmetric, it follows 
that gi G supp(^j_i) if and only if g[ G supp(^_i). Therefore the terms u)(h)h[gi, . . . ■ fffr] in such 
that <? = h[gi, ■ ■ ■ ,gk] are in bijection with the terms uj(h)h[g[, . . . ,g' k ] such that g' = h[g[, . . . ,g' k ]. 
So the fractional operation in ([2]) assigns the same weight to g and g'. 

Let e be an expression for t consisting of superpositions of projections and operations from 
supp(u;). We recursively define the nested depth, d = d(e), of e as follows: d(p) = for every 
projection p; and d(h[gi, . . . ,g k ]) = 1 + maxi<i< fc d(gi). 

Let supp(ii) = {gi, . . . ,g n }- Using supp(i/o) = supp(u) and the fact that supp(fj) contains all 
superpositions of operations in supp(z^_i), it follows that t[g\, . . . , g n ] G supp(z/^). Now, we add a 
child v to u for every equivalence class in the set {g \ g G supp(tv)}. For an added child v with 
supp(v) = g, we let w(v) = t>d{g)- 

Invariant (jaj) holds as t[gi, . . . ,g n ] G supp(fd) is symmetric: for all ir G S m there is a it' G 5 n such 
that t[gx, . . . , g n ] (2^(1) , . . .,a; T ( m )) = ^'(i),.. • ,&,./(„)] (xi, . . . ,x m ) = t[g u . . .,g n ](xi,. . .,x m ). In- 
variants ([b]) and (jcj) hold by construction. For each i > 1, we have 

X] M '- 1 (fi')/ j4 (9(«i, • • ■,%)) > *Y^Vi{g)f A (g(au ■ ■ ■ ,4)) 

for all / G t and ai, . . . a m G D ar ^\ Therefore invariant ([d]) also holds after expanding u. 

Pruning. The pruning step maintains an additional invariant, namely that every leaf that is not final 
is covered. Pruning is accomplished as follows. Pick a minimal covering node v. Let v = v v + v± 
be the fractional operation induced by the leaves in the subtree rooted at v, where v v is the part 
of v with the same support as v and v± is the part of v with support disjoint from v. Inductively, 
by invariant (fd|). 



v (9)f A (g(ai, • • • , a m )) > v v {g)f A (g{ai, • • • , a m )) + ^ v±{g)f A (g(ai,. . . , a m )), 

9 9 9 
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for all / £ t and 01, . . . a m G D ar ^\ We simplify this inequality as follows. 

y2v(g)f A (g(a 1 , . . . ,a rn )) > V v±.{g)f A {giflx, . . . ,o m )), 

3 9 

where k = ||mo||i/||«||i. 

Remove all nodes below v and add a new child u to v for every equivalence class in the set 
{g | g G supp(z^_i_)}. For an added child « with supp(u) = 5, we let u>(-u) = j^v±(g). 

By invariant (jaj) the node v is guaranteed to have at least one final child (leaf). Hence, by 
invariant (jbj), v± is not identically 0. By induction on (jcj), it follows that \\v\\i > ||^||i, so k < 1 
and the new weights are defined and positive. So invariant (jb]) holds. Furthermore, 

Nil = T~ — ll^-J-lll = T~ — (IMIl - IKIll) = T~~ — ~ IWU) = Nil) 

L — ' 1 — K 1 — K 1 — K 

u is a child of v 

so invariant (jcj) holds. Invariant (jd|) holds by construction. Finally, invariant (jaj) also holds since 
for any final child u of v, there is still a child of v with support on the same equivalence class as u. 

Only nodes in the subtree rooted at v have been removed and every child added to v has the 
same support as a previous leaf of this subtree. Every such leaf u that was not final was covered 
by a node above v in the tree. Hence, all leaves in the tree that are not final are still covered. □ 

5. General-valued Structures 

The valued structures we have dealt with so far were in fact finite-valued; i.e., for each function 
symbol / G r, the range of f A was Q>o- We now discuss how our result can be extended to the 
general-valued case, in which for each function symbol / G r, the range of f A is Q> = Q>o U {00}. 
(We define c + 00 = 00 + c = 00 for all c G Q>o, and Ooo = 00O = 0.) 

Inspired by the OSAC algorithm |13| . the algorithm for general- valued structures, denoted by 
BLP 9 , works in two stages. Firstly, the instance is made arc consistent using a standard arc 
consistency algorithm [23] Secondly, BLP (i.e., linear program (1) from Section [3j) is solved. 

Definition 4. Let A be a general-valued t -structure, and let D = D(A). An m-ary operation g : 
D m — > D is a polymorphism of A if for every function symbol f G r and tuples a\,..., a m G D ar ^\ 
it holds that Feas(f A (g(a\, . . . , a m ))) < YliLi Feas(/ j4 (aj)), where Feas(oo) = 00 and Feas(c) = 
for any c G Q>o- 

From Definitions [1] and HI if a; is a fractional polymorphism of a general- valued structure A, then 
every g G supp(w) is a polymorphism of A. In fact, any operation g that is generated by supp(w) 
(i.e., g belongs to the clone generated by supp(w)) is a polymorphism of A. (For finite- valued 
structures, trivially, every operation g is a polymorphism.) 

Arc consistency (also known as (1, fc)-consistency) [23] is a decision procedure for precisely those 
{0, oo}-valued structures A that are closed under a set function g : 2 D ^ \ {0} D(A) [191121] . 
This condition has recently been shown to be equivalent to the requirement that A should have 
symmetric polymorphisms of all arities [39] . 

Our main theorem (Theorem I4.ip also holds for general- valued structures: 

Theorem 5.1. Let A be a general-valued structure over a finite signature. TFAE: 

(i) BLPg solves VCSP(A). 

(ii) For every m > 1, P m (A) — >f A. 

(in) For every m > 1, A has an m-ary totally symmetric fractional polymorphism, 
(iv) For every n > 1, A has a fractional polymorphism u n such that supp(w n ) generates an n-ary 
symmetric operation. 



The algorithm from [23] is sometimes called generalised arc consistency algorithm to emphasise the fact that it 
works for CSPs of arbitrary arities, not only for binary CSPs [41] . 
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Proof. Note that §u$) implies that A has symmetric polymorphisms of all arities. This follows 
from Lemma 12.21 which holds for general- valued structures, and the above-mentioned fact that 
any g G supp(a;), where a; is a fractional polymorphism of A, is a polymorphism of A. The same 
argument guarantees symmetric polymorphisms of all arities in (jmfl and in (jSJ, we use that 
fact than any operation generated by supp(w n ) is a polymorphism of A. 

Theorem 14.21 proves dii]) =>■ (0) since the assumption of having symmetric polymorphisms of all 
arities guarantees a feasible solution to (pQ). From the discussion above on arc consistency, if BLP g 
solves VCSP(^4), then A has symmetric polymorphisms of all arities since arc consistency decides 
the existence of a finite- valued solution. Furthermore, the proof of Theorem 14.31 shows that having 
symmetric polymorphisms of all arities but not having a fractional homomorphism P m {A) —>f A 
implies that BLP 5 does not solve VCSP(A). This gives (jij) => (jUJ). (jUJ) -£4> (Jmj) and (lml) pu]) are 
proved the same way as in Theorem 14.11 by Lemma 12.21 and Theorem 14.41 respectively. □ 

Remark 1. BLP g for general-valued structures uses the arc consistency algorithm \23^ and BLP. 
Since Kun et al 139)1 have shown that BLP solves CSPs (i.e., {0, oo}-valued VCSPs), if represented 
by {0, l}-valued structures, of width 1 - thus providing an alternative to the standard arc consistency 
algorithm ]23^ - a different approach is to combine Theorem \4- l\ from this paper with 139)[ and solve 
general-valued structures using only BLP with an amended objective function which takes care of 
infinite costs using a large (but polynomial), instance- dependent constant. 

6. Tractable Valued Constraint Languages 

As before, we denote D = D(A). A binary multimorphism [11] of a valued structure A is a pair 
(#1,(72) of binary functions #1,32 : D 2 — > D such that for every function symbol / G r and tuples 
01,02 € £> ar(/) , it holds that 

f A (9i(ai, 02)) + f A (92(ai, o 2 )) < f A (ai) + f A (a 2 ). 

(Multimorphisms are a special case of fractional polymorphisms.) Since any semi-lattice operation^ 
generates symmetric operations of all arities, we get: 

Corollary 6.1 (of Theorem 15. ip . Let A be a valued structure with a binary multimorphism (51,52) 
where either g\ or g 2 is a semi-lattice operation. Then A is tractable. 

We now give examples of valued structures (i.e., valued constraint languages) defined by such 
binary multimorphisms. 

Example 1. Let (D; A, V) be an arbitrary lattice on D. Assume that a valued structure A has the 
multimorphism (A, V). Then VCSP(A) is tractable. The tractability of A was previously known 
only for distributive lattices [28,48] and (finite- valued) diamonds [38], see also [37] . 

Example 2. A pair of operations (51,52) is called a symmetric tournament pair (STP) if both 51 
and 52 are commutative, conservative (gi(x,y) G {x,y} and g 2 (x,y) € {x,y} for all x,y G D), and 
g±(x,y) 7^ g 2 (x,y) for all x,y £ D. Let A be a finite-valued structure with an STP multimorphism 
(51,52). It is known that if a finite-valued structure admits an STP multimorphism, it also admits 
a submodularity multimorphism. This result is implicitly contained in [10] li Therefore, BLP solves 
any instance from VCSP(A). 

Example 3. Assume that a valued structure A is bisubmodular [21]. This means that D = {0, 1, 2} 
and A has a multimorphism (mino, maxo) [11] . where mino(a;, x) = x for all x G D and mino(a;, y) = 
for all x,y G D, x 7^ y; maxo(x,y) = 0if0^x^5^0 and maxo(x,y) = max(x,y) otherwise, 

^A semi-lattice operation is associative, commutative, and idempotent. 

^Namely, the STP might contain cycles, but [101 Lemma 7.15] tells us that on cycles we have, in the finite-valued 
case, only unary cost functions. It follows that the cost functions admitting the STP must be submodular with 
respect to some total order. 
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where max returns the larger of its two arguments with respect to the normal order of integers. Since 
mino is a semi-lattice operation, A is tractable. The tractability of (finite-valued) A was previously 
known only using a general algorithm for bisubmodular functions given by an oracle [24^143] . 

Example 4. Assume that a valued structure A is weakly tree-submodular on an arbitrary tree |35j. 
The meet (which is defined as the highest common ancestor) is again a semi-lattice operation. 
The same holds for strongly tree-submodular structures since strong tree-submodularity implies 
weak tree-submodularity |35| . The tractability of weakly tree-submodular valued structures was 
previously known only for chains and forks [35] . The tractability of strongly tree-submodular valued 
structures was previously known only for binary trees |35j . 

Example 5. Note that the previous example applies to all trees, not just binary ones. In particular, 
it applies to the tree consisting of one root with k children. This is equivalent to structures 
with D = {0, 1, . . . , k} and the multimorphism (mino, maxo) from Example This is a natural 
generalisation of submodular (k = 1) and bisubmodular (k = 2) functions, known as /c-submodular 
functions [26]. The tractability of fe-submodular valued structures for k > 2 was previously open. 

Example 6. Let b and c be two distinct elements of D and let (D; <) be a partial order which 
relates all pairs of elements except for b and c. A pair (51,32), where 31,32 : D 2 — > D are two 
binary operations, is a 1-defect multimorphism if 31 and 32 are both commutative and satisfy the 
following conditions: 

• If {x,y} j= {b,c}, then gi(x,y) = x A y and 32(2;, 3) = x V y. 

• If {x,y} = {b,c}, then {gi(x,y), g 2 (x,y)} n {x,y} = 0, and gi{x,y) < 32(^,3)- 

The tractability of valued structures that have a 1-defect multimorphism has recently been shown 
in |32| . We now show that valued structures with a 1-defect multimorphism are solvable by BLP 9 . 

Without loss of generality, we assume that 31(6, c) < 6, c and write 3 = g\. (Otherwise, 32 (b, c) > 
6, c, and 32 is used instead.) Using 3, we construct a symmetric m-ary operation f(x±, . . . ,x m ). 

Let /1, . . . ,/m be the M = (™) terms g(xi,Xj). Let / = g(fi,g(h,.. ■ , 3(/iW-l, Jm) •••))• There 
are three possible cases: 

• {b,c} ^ x i-> ■■■■,x m . Then 3 acts as A, which is a semi-lattice operation, hence so does /. 

• {b, c} C {xi, x m } and g(b,c) < x±, . . . ,x m . Then /j =3(6,0) for some 1 <i < M, and 
9{fi,fj) = g{b,c) for all 1 <j < M, so f(x 1 , . . .,x m ) = g{b,c). 

• {b, c} C {xi, . . . , x m } and there is a variable x p for some 1 < p < m such that x p < g(b, c) 
and x p < x%, . . . , x m . Then g(x p , x q ) = x p for all 1 < q < m so /, = x p for some 1 < i < M 
and g(fi, fj) = x p for all l<j< M, so /(an, . . . , x m ) = x p . 

7. Conclusions 

We have characterised precisely for which valued structures the basic linear programming relax- 
ation (BLP) is a decision procedure. This implies tractability of several previously open classes of 
VCSPs including several generalisations of submodularity. In fact, BLP solves all known tractable 
finite- valued structures. 

The main result does not give a decidability criterion for testing whether a valued structure is 
solvable by BLP. Interestingly, all known tractable finite-valued structures have a binary multi- 
morphism. It is possible that every (finite-)valued structure solvable by BLP admits a fixed-arity 
multimorphism, which would give a polynomial-time checkable condition. 

An intriguing open question is whether our tractability results hold in the oracle-value model; 
that is, for objective functions which are not given explicitly as a sum of cost functions, but only 
by an oracle. For instance, the maximisation problem for submodular functions on distributive 
lattices, known to be NP-complete, allows for good approximation algorithms in both models [22J. 
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Appendix A. Proof of Lemma 12.21 

Lemma A.l. Let A be a valued structure and m > 1. Then P m (A) —>f A if and only if A has an 
m-ary totally symmetric fractional polymorphism. 

Proof. Let D = D(A). 

(=>) Let wbea fractional homomorphism from P m (A) to A. Let h : D m — > (jf -0 )) be the function 
that sends a tuple (a±, . . . , a m ) G D m to its multiset [ai, . . . , a m ]. Then the composition u o h is 
the desired fractional polymorphism. 

(■<=) Let w be an m-ary totally symmetric fractional polymorphism. Every operation g G supp(o;) 
induces a function </ : (( m )) — > D. Define u' as the fractional homomorphism with oj'(g') = oj(g). 
Let / be a fc-ary function symbol in the signature of A, let ati, ■ ■ ■ , G f(~)) be arbitrary, and 
pick ai with [ai] = ai that minimises YlT=i f ■ • • i for 1 < z < fe. 

5^^ / (fl f/ )/ A (fl f/ («i) ) ... ) ff / (afc)) = X^flO/^Ol),- • • 
g' 9 



< 



1 m 
m ^ — * 



m 



TO t i GC" l :[t i ]=a i ^ 



i=l 
1 m 

= -^/ Pm ^(ai,...,a fc ). 
i=l 

Hence, P m (A) -+ f A. □ 

Appendix B. Proof of Theorem 14.31 

The following variant of Farkas' Lemma is due to Gale [25] (cf. Mangasarian 

Lemma B.l. Let A G M mxn and b G M m . TTien exactly one of the two holds: 
• Ax < b for some x G 



A T y = 0, b T y = — 1 for some y G 



Theorem B.2. Let Abe a valued structure and assume that BLP solves VCSP(A). Then P m {A) —}t 
A for every m > 1. 

Proof. Let r be the signature of A and let D = D{A). We prove the contrapositive. Assume that 
there is an integer m > 1 such that P m (A) does not have a fractional homomorphism to A. Let 
O denote the set of functions from ((_)) to D. We are assuming that the following system of 
inequalities does not have a solution u : Vt — > Q>o- 

^(g)f A (g(a)) < f pm ^(a) V/ G r, a G (Q^ 
gen 

E^) = i 

gen 

w(g) > VgeQ. 

In order to apply Lemma IB. 11 we rewrite the equality ^2 g ^(g) = 1 into two inequalities 
oj(g) < 1 and — ^g^id) < — 1- The last set of inequalities are rewritten to the form —w(g) < 

for each g G SI. We have one variable for each inequality, i.e., y(f,a) for / G r, and a G ((~)) ar ^- 
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Additionally, we have two variables z + , z- for the two inequalities involving the constant 1 and one 
variable w{g) for each g G O. 

^i/(/,Q)/ A (#))+z + -^-u;( ff ) = 

E^)/^ = - 1 

y,z+,z-,w > 

We can isolate z + + z_ in the last equality, 

z+ + z _ = -l-J2y(f,a)f pm W(a), 

/,a 

which substituted into the first set of equalities implies that there is a solution y(f,a),w(g) such 
that, for each c/ G fi, 

E f (/> = «>G7) + 1 + E «)/ pm(A) («)- 

/.a /.a 

We therefore find that there is a solution to the following system: 

*£y(f,a)f A (g(a)) > ^y(f,a)f pm ( A \a) V ff GO 

f,a f,a 

y(f,a) > V/,a. 

Let / be the instance on variables ((2))- F° r each /c-ary function symbol / G t, and a G 
((S)) BP(/) . define 

/ 7 (a) = y(/,a). 

We now give a solution A, /i to the basic LP ([I]) with an objective value equal to the right-hand 
side of Each variable fj, a (a) is assigned the value of the multiplicity of a in a divided by m. 
Given f,a, let i\, . . . ,tk G D m be such that f pm( - A \a) = ^ YliLi f A (ti [i], ■ ■ ■ , £&[«]), and assign 
values to the A-variables as follows: 

A/,a,er = — 10 | = for all j}\ 

m 

Note that Yla-a(a\j])=a ^f,a,a = A*a[j]( a ) f° r all 1 < j < A; and a € D. Furthermore, A is defined 
so that f pm ( A '(ot) = J2a:{a}->D f A ( a (° e ))^f,a,v Hence, the variables A, fj, satisfy the basic LP ([I]), 
and we have 

(3) BLP{I,A)<Y,?fr) E / A K«))W = E/ / («)/ Pm(A) («)' 

f,a a:{a}— >D f,a 

where the sums are over / G r and a G {{^1)^^ ■ 

It now follows from ([3]) and ([3]) that the measure of any solution g : ((£?)) — > -D to 7 is strictly 
greater than BLP(J, A). Consequently, BLP does not solve VCSP(.A). □ 

Appendix C. Optimal Soft Arc Consistency 

In this section we define optimal soft arc consistency, which is closely related to BLP given by (pQ) 
in Section [3l 

Let / and A be valued structures over a common finite signature. Let X = D(I) and D = D(A). 
We will group the terms of an instance with respect to their scope. Let S Q X. The terms of this 
scope are those of the form f I (x)f A (a(x)), where {x} = S, and ar(/) = \x\. For each scope S, 
x G S, and a : S — » D, we have a variable y5 j3; ((j(x)). For each x G X, we have a variable z x - 
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Establishing optimal soft arc consistency (OSAC) amounts to solving the following linear pro- 
gram |13j : 



max 



£ 



(4) s.t. Yl f I( ^)f A ^))-YjysA^)) >0 VSQX,*:S^D 

{x}=S,f xeS 

E u I {x)u A {a{x)) - z x + J2 ysA a ( x )) > Vx e X,a : {x} ^ D 

u S:xeS 



We refer the reader to |13| for more details, but the idea behind §4$ is that it gives the maximum 
lower bound on Opt yl (/) among all arc-consistency closures of the given instance /, where the closure 
is obtained by repeated calls of three basic operations called Extend, Project, and UnaryProject. 

We will be interested in the dual of (jH). The dual has variables \s j(T for S C X and a : S — > D, 
and variables fi x (a) for x € X, a € D. 



£ ( £ / 7 (s)/V(^)))a5,.+ E (£^)^m*)))^(^)) 

SCX,a {x}=SJ x£X,a u 

As jCT = /u x (a) VS 1 C X, x £ S, a G Z) 

(r:a-(x)=a 

/^(a) = 1 Vx G X 

ag-D 

A,^X > 

Note that ([5]) is a tighter relaxation than (pQ) as it has only one variable A for all constraints with 
the same scope (seen as a set) of variables. In ([T]), different constraints have different variables A 
even if the scopes (seen as sets) are the same. Consequently, OSAC solves all problems solved by 
BLP. Moreover, since the basic SDP relaxation of a VCSP(j4) instance is tighter than BLP [45 1, 
the basic SDP relaxation also solves all tractable cases identified in this paper. 



min 
s.t. 

(5) 



